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We show by direct calculation that the replica and cavity methods are exactly equivalent for the 
spectrum of Erdos-Renyi random graph. We introduce a variational formulation based on the cavity 
method and use it to find approximate solutions for the density of eigenvalues. We also use this 
variational method for calculating spectra of sparse covariance matrices. 
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I. INTRODUCTION 

Random matrix theory is a discipline with wide range 
of physical applications and plenty of beautiful mathe- 
matical results [ij . One of the aspects which makes the 
problem extremely complex is the fact that real physi- 
cal systems are embedded in three-dimensional Euclidean 
space. Their Hamiltonian is often a random matrix, but 
the randomness is constrained in a highly non-trivial way. 

The constraints are relatively less severe in the atomic 
nucleus, where the three-dimensionality of physical space 
is of secondary importance. Hence the spectacular suc- 
cess of the early works in random matrix theory, due to 
Wiener 0,11 and Dyson On the other hand, the fun- 
damental constraint arising from two-body character of 
the interaction within the (model of an) atomic nucleus 
induces several drastic changes [H-Q. Most importantly, 
the density of states is not a semi-circle, as suggested by 
Wigner, but rather it follows a Gaussian shape. There- 
fore, sharp band edges are missing and Lifschitz tails de- 
velop. For the current state of the problem, see e. g. the 
review (loj . 

Even more complicated situation arises in all random 
extended systems, like disordered or amorphous semicon- 
ductors, where we must take into account the Euclidean 
constraints. Perhaps the easiest of these constraints is 
the sparsity of the Hamiltonian matrix, which is due to 
finite range of interactions. If we forget the even more 
severe complications due to precise number of spatial di- 
mensions (in reality one, two or three), we are left with 
the problem of determining the spectrum of a random 
sparse matrix. 

Important breakthrough was achieved using the replica 
method, which was introduced in the context of random 
matrices in ll| . Rodgers and Bray, in their classical work 
[13] , solved the problem in the sense that they found an 
integral equation for a quantity from which the density 
of states is readily obtained. Unfortunately, that equa- 
tion still resists all attempts for exact analytic solution. 
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In [12l ]. two approximative solutions were found. First, 
in the form of a series expansion, whose leading term co- 
incides with the Wigner semicircle law. Second, using 
a non-perturbative argument, introduced earlier in [T3| . 
the shape of the Lifschitz tails in the density of states 
was found. 

The replica method for treating spectra of sparse ma- 
trices was further developed [14| - |28| . Especialh;, the 
variational formulation of the replica equations [Tol . [20l . 
|27| enabled generating self-consistent approximations, 
namely the effective medium approximation (EMA), 
which is analogous to the coherent potential approxima- 
tion used for electrons in random potential. In these ap- 
proximations, Lifschitz tails in the spectrum are absent. 
Further sophistication of the method consists in the sin- 
gle defect approximation (SDA), which obtains the Lifs- 
chitz tail in the form of infinite sequence of delta-peaks. 

The complexity of the problem becomes evident when 
we compare these results with the density of states ob- 
tained by numerical diagonalization of large sample ma- 
trices [23, [29. - 33.] . The Lifschitz tail is smooth, while the 
bulk of the density of states is the combination of con- 
tinuous component with a set of delta-peaks. The most 
marked of these peaks is at the origin, others at eigenval- 
ues z — ±1, ±-\/2 etc. All these structures should emerge 
from the solution of the Rodgers-Bray integral equation, 
but EMA, as well as SDA, miss all of them. The set of 
delta-peaks was studied separately in [s^ , but a the- 
ory which would combine naturally both these peaks and 
the continuous component is still unavailable. 

More recently, spectra of sparse matrices encoding the 
structure of random graphs were studied successfully us- 
ing the cavity approach (see e. g. [Ill)- It is based on the 
fact that large random graphs are locally isomorphic to 
trees. This was used e. g. in (35l - [37| to calculate spectra 
of adjacency matrix and Laplacian on complex networks. 
In [33, [11] , a "self-consistent" version of SDA was used to 
obtain asymptotic shape of the Lifschitz tails, which de- 
cay as a power law in the case of scale-free networks. In 
|37| a more sophisticated calculation lead to an integral 
equation similar to Rodgers and Bray's [l^], from which 
the asymptotics of Lifschitz tails is found. The cavity 
method provides an easy way [ssl to obtain the Wigner 
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semicircle law, as well as the Marcenko-Pastur law for 
spectrum of covariance matrices. It can be also used as 
an efficient numerical procedure [13] , reproducing all pe- 
culiarities of the density of states, including Lifschitz tails 
and delta-peaks. The mathematical justification for the 
use of the cavity approach can be found in (slj. 

Very powerful method for computing spectral proper- 
ties of random matrices is based on supersymmetry and 
was developed in [sH, |40| (see also the review [4l| and 
a recent development in ^^). Initially, the results of 
replica and supersymmetric methods were found in con- 
flict, which resulted in serious criticism of the replica trick 
in general [i^j ■ Density of states of sparse random matri- 
ces was calculated using sup ersy mmetry (43 |. leading to 
an equation which was later [45| shown equivalent to the 
replica result of [l^l- However, the correlation of eigen- 
values, which was investigated in [i^ using supersymme- 
try for the case of sparse matrices, was not reproduced 
correctly in replica method, until the integral over all 
saddle points was properly taken in (47[ . Since then, the 
replica method regained its reputation as an equivalent 
alternative to supersymmetric methods. This was fur- 
ther supported by a series of papers [isl - lsoj . Finally, let 
us only mention the works which approach the density of 
states by computing exactly the moments [3l|, [5l| . 

In this paper, we show an alternative method to ob- 
tain the Rodgers-Bray integral equation using cavity ap- 
proach. Therefore, we prove exact equivalence of replica 
and cavity method in this case, which was previously 
assumed only on the basis of topological considerations 
concerning random Erdos-Renyi graphs. Moreover, as an 
important by-product of this proof, we present a varia- 
tional formulation of the problem, which serves as useful 
generator of self-consistent approximations. 



II. PROJECTOR METHOD 

We shall investigate the spectrum of the adjacency ma- 
trix L of an Erdos-Renyi random graph with N vertices. 
Therefore, the probability distribution of the matrix ele- 
ments factorizes 

i<j i 

where the probability density for a single off-diagonal el- 
ement is 

M^)={^-J^)si^) + ^S{x-l). (2) 

The key ingredient of all subsequent analysis is the resol- 
vent 



R{z) = {z-L)-^ 



(3) 



and its average {R{z)) over disorder, taken with the dis- 
tribution ([T]) . It contains information on the average den- 
sity of states (here we assume z on the real axis) 



Viz) = lim Tr {R{z - ie)) 



(4) 



In the spirit of the cavity method, we focus on a single 
vertex, surrounded by the rest of the graph. To calculate 
the diagonal element of the resolvent on this vertex, we 
use the projector method, formulated generally in |52|. 
For a different route which also leads to equivalent re- 
sults, see [131 ■ Let us have an arbitrary projector P and 
its complement P'~^ = 1 — P. Then, the projected resol- 
vent is ^52i] 
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P{z- L)P 



PLPC pCLP 

z — L 
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We denote the singled-out vertex as i = 0. Let Po 
be the projector to this vertex. Furthermore, denote 
i = 1, 2, . . . , fc neighbors of the vertex on the graph 
represented by the matrix L and denote also Pi projec- 
tor to the neighbor i. Let us use composite indices for 
other vertices. If ki is the number of neighbors of z, de- 
note [i, 1], [z, 2], . . . , [i, fci — 1] the neighbors of vertex i, 
except the vertex 0. The projectors to the second neigh- 
bors of will be denoted using these indices, so Pi^ii is 
projector on the vertex [?,?']. By analogy, we define the 
projectors to third, fourth etc. neighbors of 0. Note that 
on a general graph, some of the projectors may coincide, 
due to the presence of cycles. 

The cavity approach consists in replacing the graph by 
a tree, which is locally isomorphic to it, i. e. neglecting 
all cycles on the graph. Algebraically, it is equivalent to 
the assumption that the complementary projectors can 
be written as direct sums of projectors corresponding to 
separate branches of the tree 
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where P(i)Pi = Pi, P{i,t')Pi,i' = Pi,t', and so forth. 

Using the projectors we define the series of scalar func- 
tions related to the resolvent 



giz) = PoR{z)Po 
P ^ 

g,{z) ^P,^-P, 
z — L 

P(€) Pr' 



gi,t'{z) = Pi^ 



gi,i',i"{z) = Pj, 



z- L 



■P / 



(7) 



z-L 



-P ■// 



From ^ and the assumptions ^ we have the chain of 
equations for these functions 
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^ - = l 9r.i' {z) 



(8) 



On a random tree, the deg random 
variables and therefore also g{z), gi{z), giit[z), etc. are 
random functions of z. To describe their properties, we 
define their generating functions (dependence on z be- 
comes implicit) 



G(c.) 

G2{UJ) 



9i,i' 



(9) 



property of the Poisson distribution, kP{k)/fi = P(fc— 1). 
For any other distribution this does not hold. 

For infinitely large tree we suppose that the generating 
functions Gm, m = 1, 2, 3, . . . converge to a common limit 
and we can impose the condition of stationarity Gi{uj) — 
6*2(0;). Therefore, we define a single function 7(0;) — 
G{uj) — 1, for which we have a closed equation 



7(w) 



dX 

7t 



/i(2%^A)e-^^+^'^(^) . (14) 



It is strictly equivalent to the Equation (18) in [ij] (the 
Rodgers-Bray equation), which was obtained using the 
replica method. Hence we conclude that explicit calcula- 
tion showed equivalence of replica and cavity approaches 
in the case of Erdos-Renyi graph, which is just the sit- 
uation in which the Rodgers-Bray equation holds. Note 
however, that the direct computation we used here would 
fail if the degree distribution was not Poissonian. 



III. VARIATIONAL PROBLEM 



If the graph in question is the Erdos-Renyi random graph, 
all the degrees in the corresponding random tree are in- 
dependent and distributed according to the Poisson dis- 



tribution P{k) 



^'^/kl. The average degree ^ is the 



only free parameter of this model. 

Calculation of the generating functions ([9|) is facilitated 
by the integral representation 



.9(2) 



(10) 

and similarly for the other g's. Assuming for the moment 
that k is fixed, we get, after some algebra, the following 
relation between G(a;) and Gi(w) 



G(^) 



f°° dX 

1 + V^ / —h{2^AJX)e- 
Jo V A 



Xz 



[Gi{X)f ■ (11) 



Now we take into account the Poisson distribution of de- 
grees, which gives 



r°° d\ 

l + V^ ^/i(2v^)e 
Jo V A 



-\z+fj.{Gi{\)~l) 



G{lu) 

./n VA 

(12) 

Repeating the same steps for further generating functions 
we get 



1 + V^ / ^/i(2\/^)e" 
Jo V A 



A2+Ai(G2(A)-l) 



Giiuj) 

Jo VA 

(13) 

Note that the form of the relation between G and Gi is 
the same as between Gi and G2 and generally between 
Gm and Gm+i for any m > 0. This is due to special 



The key result (|T4)) can be reformulated in a differ- 
ent way, more appropriate for approximate solution. As 
a first step, we define an auxiliary function p{uj) — 



Instead of the single equation p^ . we can 



solve the pair 



7(0;) 



dX 

7x 



h(2^)p{X) 



(15) 



p{uj) 



-UJZ + f2.-l{ul) 



Direct solution of p3|) is as difficult as solving ([T^ . How- 
ever, we can find a functional, whose stationary point is 
just defined by equations ([T5l). We can check explicitly 
that such functional is 



•^[7,P] = -/ — 7(^)p(^)+ 
Jo w 

1 f°° dio dX ^ ,^ , ^ 

2 7o Jo VX 
1 f°° di^ ujz+fi-ri'^) 



(16) 



Jo 



Note that we derived, within the cavity approach, a result 
which is analogous to the functional obtained in [27] using 
the replica trick. 

The variational formulation of the prob lem is useful 
as a generator of approximations. In [20| a variational 
ansatz was used to derive the density of states in effective- 
medium approximation (EM A). Let us see now how it is 
obtained in our cavity procedure. If we take the expo- 
nential ansatz for the auxiliary function /^(a;), namely 



(17) 
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all integrals in p6|) can be performed explicitly and we 
can extremalize the functional with respect to a and 
7(0;). This way we find the cubic equation 



CT^-zo-^ + (//-l)cr + z = 



(18) 



It is identical to the equation (23) in [20] obtained by 
the replica method. The solution can be obtained ana- 
lytically and the density of states is extracted using the 
formula 



27(z) = lim Im 



1 



0+ TT a{z — ie) 



(19) 



We can further improve the calculation by the follow- 
ing trick, which we shall refer as "single-shell approxima- 
tion" within this paper. We may formally write the pair 
of equations (jlSp as a set of four equations 



7(w) 



-,J^ -^/i(2V^)p(A) 



p(w) =e-"^+^'^(") 
p(w) =e-'^^+^'^(") 



(20) 



/i(2V^)p(A) 



These equations can be obtained as a condition of sta- 
tionarity for the functional 



did 



— (-/{uj)p{uj)+-f{uj)p{uj) 
dX 







Vx 



h{2V^)p{oj)p{X)+ (21) 



du) 



If the equations (pOj) were solved exactly, we would 
have 7(cij) = 7(w) and p{u!) = p(w). The same would hold 
also in the case of the effective medium approximation, 
which amounts taking the ansatz p(w) = p(w) = e~'^", 
so seemingly the set (pn|) does not bring any advantage 
over (jisp. However, relaxing the condition p{uj) = 'p{uj) 
we can get an improvement in an approximate solution. 
Indeed, we can take the ansatz 



p{uj) 



(22) 



as in EMA, but allow p(i^) adjust itself freely so that 
IFi is stationary. This way we introduce an error, be- 
cause p{uj) ^ p(a;) and 7(cli) 7^ 7(w), but we gain better 
approximation for the density of states. 

After some algebra, we get the following equation for 
the quantity t = z a 



z = p 



The fact that the equation depends on means that the 
spectrum is symmetric with respect to the point z — 0. 
For a general z on the real axis the equation (|23|) can 
be easily solved numerically. We find that there are at 
most two roots with non-zero imaginary parts (complex 
conjugate to each other). Those values of z for which 
all solutions are real correspond to gaps in the spectrum. 
General picture is that there is a very narrow gap around 
z = 0, separating two halves of a wide band, containing 
most of the eigenvalues. We can call this band (not quite 
precisely) as "bulk" of the density of states. 

In the middle of the bulk, there is a i5-function contri- 
bution just at 2; = 0, whose weight can be found exactly 
and is equal to e~'^. On both sides of the bulk, there are 
series of small side bands separated by gaps. The density 
of states has therefore the form 



V{z) = e->'S{z)+Vc{z) 



(24) 



where T^ci^z) is a continuous function. The interpretation 
of the (5-function is straightforward. It corresponds to 
single isolated vertices, whose fraction is just equal to 
e"'' and they all contribute with the same eigenvalue 0. 

Some analytical information on the continuous part 
2?c(-z) can be found from approximate solution of the 
equation (|23l) . For e~'^ ^ 1 we can find approximately 
the edge of the gap around z — 0. We get 



Vc{z) 



where we denoted 



1 



271 z 



z^ — e 



(25) 



,1 



1=1 



We can see that the gap edge is at zq = / \/tpip-)- 

For the tails, we can calculate analytically the side 
bands in an approximation which becomes exact for 
\z\ 00. The computation goes as follows. Each of 
the side bands can be identified with one term in the 
infinite sum over / in (j23p . The tails of the spectrum cor- 
responding to large \z\ are identified with large I. In the 
crudest approximation, the solution is r ~ /. Therefore, 
we introduce a new variable rj hy t — I + rj. So, 
assumes the form 



z — p + I + 7] + e 



I 

{i-iy. Vj^ 
I' 



(27) 



i'=i 



(I'-iy. i-i'-T] 



For large I we can expand the infinite series in powers of 
77 and keep only the lowest terms, so 



z^=p + Ai{p) + l+{l- Flip)) 77+ 



(28) 
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where 



I' 



I' 



(l'-l)l I -I' 

i'=i 



OO /' 



I' 



(29) 



i'=i 



So, for each /, large enough, we have two "bubbles" of 
non-zero density of states. The two bubbles are symmet- 
ric to each other with respect to the origin. The "bub- 
bles" are separated by gaps, so each "bubble" has well 
defined lower and upper edges, zi- and zi+, respectively. 
For large I the approximate form of the "bubble" is given 
by the solution of a quadratic equation in 77, so 



(i-r,(M)) 



e-^ I ^j} 



z'^ - fi - I - Ai{^i) 



1/2 



e-'^^/i' 
(7^ 



(30) 



+ (z^ - /i - 0^+ 



The width of the bubble z/+ — z/_ approaches zero for 
Z — ^ 00. This justifies considering 77 a small parameter 
in the expansion (|28p . For large I the "bubbles" have a 
semi-circle shape and their weight is 



Wi 



Viiz) dz 



1 



(31) 



We recognize the Poisson distribution with mean fi. This 
reflects the Poisson distribution of degrees of the random 
graph. The factor 1/2 stems from the fact that we have 
two bubbles for each I. Th e center of the bubble corre- 
sponding to I is at zi = y^l + + Ai{fj,), thus the dis- 
tance between two successive bubbles is Azi ~ {4zi)~^^^. 
Hence we deduce the approximate density of states in the 
tails, for Izl — > cxi 



Aaii(z) 



1^1 r 



1 



(32) 



This is the shape of the Lifschitz tail, which was already 
obtained by and [10]. 

To assess the quality of the approximations used, we 
compare the results arising from EMA (Eq. ([TS])'). from 
the single-defect [13, [Hi, and single-shell (Eq. ^) ap- 
proximations with average density of states obtained by 
numerical diagonalization of sample matrices. In Fig. 
[T] we can see the spectrum for = 3 and matrices of 




FIG. 1: Density of states for the adjacency matrix of Erdos- 
Renyi graph, with average degree fj, = 3. Full line shows the 
result of numerical diagonalization of matrix of size N = 1000, 
averaged over 75000 random realizations. The dotted line is 
the result of effective medium approximation, the dot-dashed 
line id the single-defect approximation, and the dashed hne 
is the single-shell approximation. In the inset, detail of the 
density of states around the center of the band, plotted in 
semi- logarithmic scale. 



size N — 1000 averaged over 75000 realizations. We can 
clearly identify the delta-peaks, as well as the compli- 
cated shape of the continuous part of the spectrum near 
the center of the bulk. Interestingly, both EMA and 
single-shell approximations are very good if we are nei- 
ther close to the center nor at the tails of the spectrum. 
Close to the center, the shape of the density of states is 
rather complex, as shown in the inset in Fig. [T] There is 
a shallow depression, followed by a divergence at 2; = 0. 
The form of the singularity at z = seems to be close to a 
logarithmic divergence, although the data do not provide 
a decisive evidence. Neither of the three approximations 
reproduces this singularity. EMA and SDA are constant 
around z = 0, while the single-shell approximation exag- 
gerates the depression around z = to such extent that 
a spurious gap is created. This is an artifact of the ap- 
proximation. However, the delta-peak at the origin is, 
correctly, present in the single-shell approximation. 

Similar comparison was done also at the tail of the 
density of states. We can see in Fig. [2] a detail of the 
same data as shown in Fig. [TJ Note that, for any finite 
N, the density of states is not mirror-symmetric with re- 
spect of the line z = 0, because the average value of the 
off-diagonal elements of the matrix L is strictly positive. 
Only in the limit iV — >■ 00 the spectrum becomes sym- 
metric. The single largest eigenvalue is split off the rest 
of the spectrum [53] and the small bump in the positive 
tail corresponds to this effect. In the limit iV — >■ 00 this 
bump would vanish, as the weight of the single largest 
eigenvalue becomes negligible compared to the rest of 
the spectrum. 

As shown in Fig. [51 we can see that the single-shell ap- 
proximation is superior to both EMA and SDA in the tail 
region, from two aspects. First, the spurious band edge 
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FIG. 2: The detail of the left tail of the density of states shown 
in Fig. [T] The full line shows the result of numerical diag- 
onalization, the dotted hne is the result of effective medium 
approximation, the dot-dashed line id the single-defect ap- 
proximation, and the dashed line is the single-shell approxi- 
mation. 



of EM A and SDA is shifted towards larger \z\, so that 
the interval in which D{z) is well reproduced is wider. 
Second, the single-shell approximation displays non-zero 
density of states also in some regions of the Lifschitz tails, 
although, instead of exhibiting a smooth behavior every- 
where, the density of states is concentrated in "bubbles" . 
The gaps separating the "bubbles" are again artifacts 
of the approximation, to the same extent as the sharp 
band edge is an artifact of EMA and SDA. On the other 
hand, it is an important improvement over SDA [2Cl| . The 
delta-peaks of SDA are widened into continuous bands 
in our approach. In fact, this is to be expected, because 
the single-shell approximation can be rightly interpreted 
as a self-consistent version of SDA. Therefore, it should 
be better than SDA in principle, although this a priori 
judgement may turn incorrect in practice, as the single- 
shell approximation is better than SDA sometimes (in 
the tail) but worse elsewhere (around z = 0). 

Finally, let us note that similar "bubbles" at the tails 
were also seen in approximations derived using replica 
method by [2l| for the Laplacian of a random graph and 
by for sparse covariance matrices. 



IV. COVARIANCE MATRICES 

Another application of the method presented here is 
investigation of sparse covariance matrices. They can be 
considered as arising from a bipartite graph where edges 
connect vertices from the set A with vertices from the set 
B. We denote the size of the sets Na and Nb, respec- 
tively. In the thermodynamic limit, Na oo, Nb — > oo, 
we fix the ratio a = Na/Nb constant. In the bipar- 
tite analog of Erdos-Renyi random graph, the degrees if 
vertices in A and B follow Poisson distributions with av- 
erage degree fiA and /^b, respectively, where ^b I P^A = oc- 



The problem has a long history, starting with the work of 
Marcenko and Pastur J54] and was investigated recently 
by replica method in [23 . 

The adjacency matrix of the bipartite graph has the 
form 



L = 





M 



(33) 



where the first block of indices corresponds to set A, 
second block to set B. We define the contraction, 
or covariance, matrix Ca — M'^M, which acts solely 
in the set A (and similarly Cb = MM^ , which acts 
solely in the set B. The spectra of the matrices L, 
Ca and Cb are closely related. We define X'a(-z) = 
lim(:^o+ Im^jg^[(z— ie— L)~^]ii/(iV^ tt) the partial den- 
sity of states of L restricted to the set A and VcAiz) — 
limg^o+ ImSiG/iK'^ - it - CA)""^]ii/(iVA tt) the density 
of states of the correlation matrix Ca- It can be easily 
shown that 



Vca{z) = ^I?A(yi) 



(34) 



This relation remains in force also after averaging over 
the randomness in the matrix M. Therefore, to calcu- 
late the average density of states of the covariance ma- 
trix Ca it is enough to investigate the matrix element 
{[{z — L)~^]ii) for any i ^ A. To this end, we define the 
generating functions 



IB 



1 for « e A 
' 1 for j e i? . 



(35) 



Further procedure follows closely that of the previous 
section. Finally, we get a set of four coupled equations, 
very similar to the set we encountered in the single-shell 
approximation 



7a(w) 
Ps(^) 

Pa{^) 



10 Vx 



h{2V^)pB{X) 



dX 



(36) 



/o Vx 



/i(2V^) pa{X) 



We can easily check that the solution of these equations 
makes the following functional stationary 

^AB [lA ,PA:7b,Pb] = 
duj 



(37) 



(jAiuj)pA{i^) + 7s('^)/3b('^)) 

/ h{2v:jx)pA{^)PB{x)+ 

Jo Jo V A 



duj 



\Ua Ub / 
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FIG. 3: Density of states for the correlation matrix based on 
sparse adjacency matrix, for a = 0.3. The average degree is 
fiA = 3 (dash-dotted hne), 5 (dotted Hne), and 50 (dashed 
hne). The fuU line is the Marcenko-Pastur density (|4ip . i. e. 
the limit fj, a ^ oo. 



For an approximate solution of the equations (|36]) we use 
again a variational ansatz. In analogy with EMA, we 
assume the following form 



(38) 



The insertion of (1551) in ([57]) produces finally two un- 
coupled cubic equations for a a and cfb- The equation 
relevant for us is 



za% + ((1 - a)fiA + a -1- z^) 



+ {l^A a + 1 — 2q;) z (Tb+z"^ a — 



(39) 



where we used a = fis/lJ-A- The average density of states 
for the covariance matrix Ca is found considering the first 
equation of ([55)1 and the relation ([M)) . thus 



T^ca{z) = ;= lim Im- 



n^/z e-!-o+ asi^/z — i() 



(40) 



The solution can be obtained analytically, but we shall 
not show the formula here. However, we can check that 
in the limit ^la — ^ oo with a and C — zj [ia fixed we get 



2?ca(C) 



1 



27raC 



y((i + V^)2-c) (c-(i-V^)^) 



(41) 



which is the Marcenko-Pastur (MP) density of states |54| . 

In Fig. [3] we show the density of states as function of 
C — zj [lA for several values of [ia^ as found by solution 
of (|5^ . We can see that the approach to MP density is 
rather slow. We found that the difference can be consid- 
ered small only at about [ia — 50. 



V. CONCLUSIONS 

We considered a random graph of large size iV — > oo 
of two types. First, a "classical" Erdos-Renyi graph, and 
second, a random bipartite graph. We calculated density 
of eigenvalues of adjacency matrices of these graphs. In 
the case of the bipartite graph, the final result was the 
density of states of the covariance matrix, defined by a 
contraction of the adjacency matrix. 

Our contribution to the problem of spectra of sparse 
random matrices consists in showing that the cavity ap- 
proach, i. e. approximation of the random graph by 
a random tree, is exactly equivalent to the calculation 
by replica method in the thermodynamic limit. Further- 
more, we demonstrated how the cavity calculation can 
be formulated as a variational problem, similar but sub- 
stantially simpler than the variational formulation arising 
from the replica method. At minimum, we do not need 
to consider the possibility of replica-breaking solutions, 
which are known to exist and contribute to the finite-size 
corrections [4?!]. We can interpret it also in the following 
manner. Since we are working directly with infinite-size 
system, = oo, the physics behind the replica-breaking 
states has no effect. 

The variational formulation introduced here is a very 
practical starting point for approximations. The expo- 
nential ansatz leads to results identical to the effective- 
medium approximation studied earlier [20]. However, us- 
ing our variational scheme, the approximation can be 
easily improved by what we call "single-shell approxi- 
mation". It produces the Lifschitz tail in the density of 
states in the form of a series of "bubbles" . We are able to 
calculate the weight and distance of the bubbles. Hence 
we arrive at average density of states in the tail, which 
is identical to the old result of Rodgers and Bray fl^. 
Furthermore, we applied the method also to the spectra 
of sparse covariance matrices, where we easily derived 
a formula generalizing the Marcenko-Pastur density of 
states. 

The variational formulation introduced here can be 
used not only as a generator of approximations, but also 
as a basis of numerical methods. Indeed, there is no 
principal obstacle for numerical extremalization of the 
functional of two variables. This contrasts with the vari- 
ational methods based on replica trick, where the replica 
limit n — ^ 0, involving analytic continuation, must be 
done after extremalization, whch makes the method nu- 
merically unfeasible. 

We believe that the method can be applied also for 
other types of random graphs. We must, however, admit 
a serious limitation of our method, which is the Poisson 
distribution of degrees of the graph. Therefore, it is, for 
example, not applicable directly for graphs with power- 
law degree distribution. We believe that the roots of this 
limitation lie quite deep. For example, to our best knowl- 
edge, there is no replica calculation available for random 
graphs defined by their degree sequence only. And, on 
the other side, there are no results from cavity method 
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for those random graphs with power-law degree distribu- 
tionjfor which rephca calculations do exist, like those of 
Ref.fS^. The point is, that for Erdos-Renyi graph, it is 
well established that the local topology is isomorphic to a 
random tree. For a graph with general degree sequence, 
non obeying Poisson statistics, this may or may not be 
true. The question of equivalence or not of replica and 
cavity methods is intimately related to the question of 
local isomorphism to a tree, which is rather complex and 
not solved in general. Hence, a successful treatment of 
such cases by both replica and cavity method in parallel. 



would require, very probably, completely novel ideas. 
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